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Abstract 



Convergence properties of time inhomogeneous Markov chain based discrete time linear consensus 
algorithms are analyzed. Provided that a so-called infinite jet flow property is satisfied by the underlying 
chains, necessary conditions for both consensus and multiple consensus are established. A recent 
extension to non homogeneous Markov chains of the classical Kolmogorov-Doeblin decomposition- 
separation homogeneous Markov chain results, is then employed to show that the obtained necessary 
conditions are also sufficient when the chain is of class V*, as defined by Touri and Nedic. It is also 
shown that Sonin's theorem leads to a rediscovery and generalization of most of the existing results in 



the literature. 

I. Introduction 

In this paper, we deal with the limiting behavior of a general linear consensus algorithm in 
discrete time. Let M = {1, . . . , N} be the set of agents. We consider iV-agent systems with 
linear update equation: 

X(n + 1) = A(n)X(n),\fn > (1) 

where X(ri), n > 0, is the vector of states and {An x n(ti)} is a chain of stochastic matrices, 
i.e, each row of A(n), > 0, sums up to 1. Since A{n) is a stochastic matrix for every n, 
sequence {X(n)} forms a backward Markov chain. 
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For the purposes of this paper, chain {A(n)} in (Q~|) will be said to form the update basis 
of the consensus algorithm. If all components of X{n) asymptotically converge to the same 
limit, irrespective of the time index n or the values at which they are initialized, unconditional 
consensus is said to occur. Furthermore, if there exists a fixed partition of the of the iV agents such 
that unconditional consensus occurs for the corresponding subvectors of X(n), then unconditional 
multiple consensus is said to occur. The subsets in the partition are then said to form consensus 
clusters. It is well known jH that under dynamics (OQ), unconditional consensus is equivalent 
to the backward ergodicity of chain {A n }, i.e. the property that backward products converge 
to matrices with identical rows. Furthermore, @], [IT81 . establish that a consensus algorithm 
with update chain A(n) will induce multiple consensus if A(n) is so-called class ergodic i.e. (i) 
for every n > 0, the product A{n)A{n — 1) ■ ■ ■ A(n ) converges, as n — > oo, (ii) set M can 
be partitioned into ergodic classes whereby i,j in M belong to the same ergodic class if the 
difference between the ith and jth rows of the mentioned product vanishes, as n — >■ oo. Under 
multiple consensus, the agents' indices within the ergodic classes are the same as those within 
consensus clusters. 

Sonin lfl31 in his so-called Decomposition-Separation (D-S) Theorem, suggests an elegant and 
illuminating physical interpretation of the dynamics in ©, which we now report for complete- 
ness; Starts with a forward propagating Markov chain {m(n)} with {Pjvxiv(^)} as its transition 
chain: 



where superindex t indicates transposition. Interpret rrii{n), i G M, n > 0, as the volume of 
some liquid, say water for example, in a cup i (out of iV cups) at time n > 0, while P i3 (n)mj(n) 
is the volume of liquid transferred from cup % to cup j at time n. The volume of liquid in cup 
i, Vz G M, is assumed to be initialized as mj(0) at n = 0. Now, let Xi(n), i G M, n > 0, be 
the concentration of a certain substance, such as sugar, vodka, etc., within the liquid of cup i at 
time n. We first assume that the volume of each cup is non zero at all times in order to make 
the concentration well-defined. Moreover, assume that for every i G M, Xi(n) is initialized as 
Xj(0) at time n = 0. It is not difficult to show that: 



m*(n + 1) = m t {n)P{n) ) \/n > 



(2) 



Xi(n + 1) 



rriiin + 1) 



, Vi G M, Vn > 0. 



(3) 
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Let 



n t 



(4) 



and matrix An x n(u) with entries A,j(n), i,j G M, be defined by: 



Ajj(n) = Pji(n)mj(n)/mi(n + 1), Vn > 0. 



(5) 



From Eqs. ©, ©, and ©, we conclude: 



X(n + 1) = A(n)X(n), Vn > 0. 



(6) 



Since A(n) is stochastic for every n > 0, {X(n)} forms a backward Markov chain with transition 
chain {A(n)} (notice the evolution is described by a right hand multiplication by a column vector 
instead of the usual left hand multiplication by a row vector), as in ([]])• Without the non zero 
volume assumption, {A(n)} is a chain of stochastic matrices with entries satisfying the following 
relation: 



The D-S Theorem describes the limiting behavior of both m{n) and X{n), as n grows large. 
However, to take advantage of the D-S Theorem in a general consensus algorithm ©, one 
has to first answer the following questions: Starting with {A(n)}, is it always possible to find 
an associated forward Markov chain {m(n)| with transition chain {P(n)} satisfying Eq. CD)? 
And how, if so? As discussed in this paper, due to existence of a so-called absolute probability 
sequence for {A{n)} as proved by Kolmogorov [11], one could show the existence of the desired 
chains satisfying Eq. ©. 

Linear consensus algorithms of type © and their convergence properties have gained in- 
creasing attention in the past decade. They were first introduced in (61, where the author 
considered the case when {A(n)} is time-invariant. Later, more general cases were considered 
in El, 0, ED, 0, M, OH, 03, E3, IH9, EEL The authors aimed at identifying sufficient 
conditions for consensus to occur, i.e., states asymptotically converging to the same value. 
Besides consensus, multiple consensus has been the subject of many articles, e.g., flU, fl9l, 
lfT3l . ifTTll . 031. Considering the work on linear consensus algorithms, 01, [|9), [fT9l appear to 
provide the largest class of chains {A(n)}, for which consensus or multiple consensus occurs in 
a system with dynamics (OQ). In this paper, it is established that based on the D-S Theorem, all 
previous results can be subsumed. Furthermore, inspired by lfT8ll . and recalling the notion of jets 
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in Markov chains from [2], we introduce a property of chains resulting in necessary conditions 
for unconditional occurrence of consensus or multiple consensus in (Q]). We also establish that 
under an additional assumption, the so-called V* property [18], these necessary conditions also 
become sufficient. 

The rest of the paper is organized as follows. In Section 2, we state necessary conditions for 
class-ergodicity and ergodicity of a chain. The D-S Theorem and its application in a general 
linear consensus algorithm are discussed in Section 3. In Section 4, we show how the D-S 
Theorem relates to and generalizes most of the existing results in the literature on convergence 
properties of linear consensus algorithms. Concluding remarks end the paper in Section 5. 

II. The Infinite Jet-Flow Property 

Inspired by work by Blackwell [2] as reported in [031 . and Touri [fT8l . in this section we 
introduce a property of chains of stochastic matrices, here called the infinite jet-flow property, 
leading to necessary conditions for ergodicity and class-ergodicity of the chain. 

Definition 1: For a given finite set M — {1, . . . , N}, a jet J in M is a sequence { J(n)} of 
subsets of M. A jet J in M is called a proper jet if ^ J{n) C M, Wn > 0. Moreover, for a 
jet J, jet-limit J* denotes the limit of the sequence { J(n)} as n grows large, if it exists, in the 
sense that the sequence becomes constant after a finite time. When the elements of the subsets 
sequence are all identical to a subset S of M , the jet will be called, jet S. 

Definition 2: A tuple of jets (J 1 , . . . , J c ) is a jet-partition of M, if (J 1 (n), . . . , J c (n)) is a 
partition of M for every n > 0. 

Definition 3: Let chain {A(n)} of stochastic matrices be given. For any two disjoint jets J s 
and J k in M, UA(J s ,J k ) or simply U(J s ,J k ) when no ambiguity results, denotes the total 
interactions between the two jets over the infinite time interval, as defined by: 



Hj{n) 



(8) 



u(r,J k ) = J2 E E E E A 

n=0 ieJ s (n+l) jeJ k (n) ie,J k (n+l) j£J 3 (n) 

Moreover, U^ n (J s ,J k ) or simply U n (J s , J k ), denotes the interactions between the two jets at 
time n. More specifically, 

U n (J s ,J k )= E M*)+ E E M") (9) 

igJ s (n+l) j€J k (n) i€J k (n+l) j£J s (n) 
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Definition 4: The complement of jet J in M, denoted by M\J or simply J, is sequence 
{M\J n }. 

Definition 5: A chain {A(n)} of stochastic matrices is said to have the infinite jet-flow property 
if for every proper jet J in M, U(J, J) is unbounded. 

Definition 6: |fl9l For a chain {A(n)} of stochastic matrices, we define its infinite flow graph, 
Ga(M, E), by a simple graph of size N, such that 

oo 

E = {{i,j)\i,j eM,ijt j, J2(Aij(n) + A 3i {n)) = oo} (10) 

n=0 

The set of nodes of each connected component of Ga is called an island of {A(n)}. 

Theorem 1: A chain {A{n)} of stochastic matrices is class-ergodic only if the infinite jet-flow 
property holds over each island of {A(n)}. 

Proof: Assume that on the contrary, {A(n)} is class-ergodic, yet some jet J in an island 
I of {A(n)} is such that Ua(J, I\J) is bounded. Thus, Ua(J, M\J) is bounded as well, since 
/ is an island of {A{n)}. Form a chain {B(n)}, an /i-approximation of {A(n)} (see lfT71 for 
a definition of h -approximation), by eliminating interactions between J and M\J at all times. 
From lfT71 Lemma 1], it is known that /i-approximations do not influence the ergodic classes of 
a chain. Therefore, {B(n)} remain class-ergodic. On the other hand, Ub(J, M\J) = 0. Given 
two distinct arbitrary constants, a\ and a 2 > let states of a multi-agent system, Yj(n), 1 < % < N, 
evolve via dynamics Y(n+1) = B{n)Y{n), Vn > 0, and be initialized at: 1^(0) = a% if i & J(0), 
and Yi(0) = a 2 otherwise. We simply conclude that for every n > 0, we have: Yi(n) = ot\ if 
i G J(n), and Yi(n) = a 2 otherwise. Since {B(n)} is class-ergodic, lim^oo Yi(n) exists for 
every i G M and the consensual agents can be grouped into clusters sharing the same limit and 
forming an ergodic class. Since the elements in {J(n)} are always associated with the same 
value of Y for any n, they will asymptotically belong to a fixed limiting cluster S* , namely 
agents for which Yi(n) converges to ot\. Since J is a proper jet in /, we have: ^ S* C I. 
Consider now jet S* on island /. From the definition of an island, we know that Ub(J*, I\J*) 
is unbounded. This is in contradiction with Ub(J,I\J) = Ub(J,M\J) = 0, and completes the 
proof. ■ 

Corollary 1: A chain {A{n)} of stochastic matrices is ergodic only if it has the infinite jet-flow 
property. 
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Proof: This is an immediate result of Theorem [TJ if we note that the infinite flow property 
of {A(n)}, is equivalent to existence of a single island, and is therefore necessary for ergodicity 
of {A(n)} (see OH). ■ 
Later on, we shall establish that the infinite jet-flow property is also sufficient for ergodicity 
provided {A{n)} is in class V*, as defined in |fl9l . 

Definition 7: A jet J in M is called a leader if the total influence of J on J is finite over 
the infinite time interval, i.e., 

oo 

E E E Mn)<oo. (id 

n=0 ie J(n+1) jeJ(n) 

Theorem 2: A chain of stochastic matrices is ergodic only if no two disjoint leaders 

in M exist. 

Proof: Assume that on the contrary, there exist two disjoint leaders J 1 and J 2 in M. Similar 
to the proof of Theorem [Q form chain {B(n)}, an li -approximation of {A(n)}, by eliminating 
the influence of J s on J s , s = 1,2, at all times. Recall that {A(n)} and {B(n)} will share 
the same ergodicity properties. Let states of a multi-agent system, Yi(n), 1 < i < N, evolve 
via dynamics Y{n + 1) = B{n)Y{n), \fn > 0, and be initialized such that for every i 6 J s (0) 
(s = 1, 2), Yi(0) = a s , where ol\ ^ a 2 . Then, for every n > 0, we have: Y^n) = a s , Vi E J s {n) 
(s = 1,2). Since «i ^ a 2 , consensus does not occur. Consequently, chain {B(n)} and thus 
{A(n)} could not possibly be ergodic. ■ 

III. Relationship to the D-S Theorem 

Consider a multi-agent system with states evolving according to linear algorithm (Q3, where 
{A(n)} is a chain of stochastic matrices. Based on the work of Kolmogorov ifTTll . we know that 
chain {A(n)} admits an absolute probability sequence ir(n) (although we do not know a priori 
how to construct it). Thus, there exists a sequence {n(n)} of probability distribution vectors 
such that 

vr*(n + l)A{n) = 7r*(n), Wn > 0. (12) 

The transition matrix sequence {P(n)} of the forward propagating chain associated with {A(n)} 
and {rr(n)} as in ©, must be such that 

m(n)Pij(n) = TCj(n + l)A^(n), Vi, j G M, Vn > 0. (13) 
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More specifically, if n^n) ^ 0, then: 

Pij(n) = TTj(n + l)A ii (7i)/7r i (n) (14) 
while if 7Tj(n) = for some i and n > 0, we choose _Py (n)'s arbitrarily such that 

AT 

5>*(n) = l. (15) 

i=i 

Note that in the former case (71* (n) = 0), Eq. (fl"5l) is authomatically satisfied, implying that P(n) 
is a stochastic matrix for every n > 0. It is easy to see that: 

it\n)P(n) = 7r'(n + 1), Vn > 0. (16) 

Thus, {7r(n)} forms a non-homogeneous forward propagating Markov chain. Let V( J s , J k ) 
denote the total flow between two arbitrary jets J s and J k in M over the infinite time interval 
as defined by: 



v(r,j k ) = J2 



i&J k (n) j£J a (n+l) i€J a (n) j&J k (n+l) 



(17) 



n=0 

where 

Tijin) = iTi(n)Pij(n) = 7tj(n + l)A^(n). (18) 

Value Tijin) can be interpreted as the absolute joint probability of being in i at time n and j at 
time n+1. Recalling U from Eq. <$8§, we note that for every J s , J k in M, V( J s , J k ) < U(J S , J k ). 
Sonin in his elegant work [fT5l characterizes the limiting behavior of the two sequences {n(n)} 
and {X(n)} (evolving via Eq. ©) in the so-called D-S Theorem as the following: 

Theorem 3: ( Sonin' s D-S Theorem) There exists an integer c, 1 < c < N, and a decomposition 
of M into jet-partition J°, J 1 , . . . , J c , J fc = { J fc (n)}, such that irrespective of the particular time 
or state at which X/s are initialized, 
(i) For every k, 1 < k < c, there exist constants tt| and X%, such that 

lim V m{n) = Ttl (19) 

n— >oo ' * 

ieJ fe (n) 

and 

lim Xj n (ra) = XI for every sequence {i„},i„ G J k (n). (20) 

n— >oo 

Furthermore, limbec $^ 6 j°(n) = °- 
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(ii) For every distinct k, s, < k, s < c: V( J k , J s ) < oo. 

(iii) This decomposition is unique up to jets { J(n)} such that for any {7r(n)} we have: 

lim V 7Ti(n) = and V(J,M\J) < oo. (21) 

iSJ(n) 

IV. Relationship to Previous Work 

A. The Class V* £7P|/ 

In the following, we apply Sonin's D-S Theorem to chains in class V* as first defined by 
Touri and Nedic [[191 . According to [19 , Definition 3], chain {A(n)} is said to be in class V* if 
it admits an absolute probability sequence uniformly bounded away from zero, i.e., there exists 
p* > such that 

7Tj(n) > p*, Wi e M, Wn > 0. (22) 

It is immediately implied that in the jet decomposition of the D-S Theorem, there is no J°. 
Otherwise, lim^oo J2iejo( n ) ^i{ n ) would be bounded away from zero by at least p*, which 
is in contradiction with the D-S Theorem. Therefore, there is a jet-partition of M into jets 
J 1 , . . . , J c such that for every k = 1, . . . , c, lim^oo X in (n) = X£ for every sequence {i n }, 
where i n 6 J k {n). Thus, we have the following theorem for chains in class V*. 

Theorem 4: Consider a multi-agent system with dynamics (0Q), where chain {A(n)} is in class 
V*. Then, the set of accumulation points of states is finite. 

Proof: Obvious if we note that {X^|l < k < c} form the set of accumulation points of 
states. ■ 
Lemma 1: If {A(n)} e V*, then for every two jets J 1 and J 2 in M, V(J X , J 2 ) = oo if and 
only if U(J\J 2 ) = oo. 

Proof: The result is obvious if one notes that p*U(J\ J 2 ) < V(J l , J 2 ) < U{J l , J 2 ). ■ 
Theorem 5: A chain {A(n)} E V* is class-ergodic if and only if the infinite jet-flow property 
holds over each island of {A{n)}. Moreover, in case of class-ergodicity of {A{n)}, islands are 
the ergodic classes of {A(n)}. 

Proof: The necessity follows from Theorem CD We now show that that if {A(n)} 6 V* is 
class-ergodic, islands are ergodicity classes of {A(n)}. If {A(n)} is class ergodic, jets in the D-S 
Theorem become time-invariant after a finite time. Thus, the jet-limits exist and are ergodicity 
classes of {A(n)}. If i and j belong to the same jet-limit, they are in the same island since 
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they are in the same ergodic class of {A(n)} ( [fT71 , Lemma 2). Conversely, assume that i and 
j are neighbors in the infinite flow graph, i.e., Yl^=o( a ij( n ) + a ji( n )) = oo. If i and j belong 
to different jet-limits J s * , J k * , then U(J s ,J k ) is unbounded. Thus, from Lemma [0 V( J s , J k ) 
is unbounded as well, which contradicts property (ii) in the D-S theorem. Therefore, every two 
neighbors in the infinite flow graph belong to the same jet-limit. Consequently, every i and j in 
the same island must be in the same jet-limit. 

To prove the sufficiency, we assume that the infinite jet-flow property holds over each island. 
Let ( J 1 , . . . , J c ) be the jet decomposition in the D-S Theorem and for every k = 1, . . . , c, 
liuin^oo X in (n) = XI for every sequence {i n }, where i n G J k (n). Let I be an arbitrary island. 
We wish to show that for every i E I, lim^oo Xi(n) exists. Pick an arbitrary jet J k among 
J 1 , . . . , J c . We show that for infinite times n: I fl J k (n) = or /. Indeed, assume instead that 
this behavior occurs only a finite number of times t, denoted ni, . . . , n t . We form a jet J in I 
such that: 

J(n) = I n J fc (n), if n ^ rii, 1 < i < t (23) 

Since the infinite jet- flow property holds over /, V(J,I\J) is unbounded, and so is U(J,I\J). 
On the other hand, except for a finite number of time indices n = rii, 1 < i < t, U n (J, I\J) < 
U n (J k ,M\J k ). This implies that U(J k ,M\J k ) is unbounded, and so is V(J k ,M\J k ) under 
the assumption that the chain is in class V* , which is in contradiction with the D-S Theorem. 
Therefore, I fl J k (n) = or / happens infinite times. This means that either one or both of the 
events / fl J k {n) = or I fl J k {n) = I occurs infinitely often. We now show that there are at 
most a finite number of times n such that / C J k {n) and / % J k {n + 1). Indeed, denote: 

e = - min{|X; - Xf\ |1 < s ^ I < c}, (24) 
3 

there exists T e > such that: 

\Xi(n)-X;\ < e, V/ = 1, . . . , c, Vi G J l (n),Vn > T e (25) 

For some given n > T € assume that: / C J k (n) and / % J k {n + 1). Then, there exists i G I 
such that i G J k {n)\J k (n + 1). In view of [|20]| and [|2TJ, we must have: 

| A M( X j( n )- X i(n))\>e (26) 
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On the other hand, 

| Mn)(Xj(n) - Mn))\ < Yl Mn)\Xj{n) - Xi(n)\ < L ^ A^n) (27) 

j£J k (n) j<£J k (n) i£J k (n) 

where 

L = max{Xj(n) - X^n), \i,j G M,n > 0} (28) 

Note that the maximum exists, since states are updated via a convex combination of previous 
states. Eqs. (|26|) and (1271) imply: 

A tJ (n)>e/L (29) 

j£J k (n) 

Therefore, 

J2J2 A ^)>J2 Ai ^ n ^ E Aij(n)>*/ L (3°) 

Since [/ (J, M\I) < oo, inequality (|30l) can only occur for finitely many times n. This shows that 
if I C J*(n) happens infinite times, then there exists T such that / C J k (n) for every n > T. 
Consequently, lim^oo Xi (n) exists, Vz G /, and is equal to X%. Therefore, assume that for a 
fixed island I, I C J fc (n) happens only finite times for every k, 1 < k < c. Thus, / D J k (n) = 
must happen infinite times, for every k, 1 < k < c. We show that such an event leads to the 
following contradiction: For every k, 1 < k < c, there exists T k > such that / R J fc (n) = 0, 
Vn > Tfc. The proof is established by induction on k. With no loss of generality, assume that 
X{ < ■ ■ ■ < X* k . 

k = 1: Recalling e and T e from Eqs. (124T ) and (1251) . assume that for a fixed n > T e we have 
/ n J x (n) = and / n ^(n + 1) ^ 0. Thus, there exists i G / such that i G J^n + l)\J 1 (n). 
Therefore, 

IMnXXjin) - Xi(n))\ >e (31) 

Noting that J^ra) C M\J, by repeating steps (l26l)- (|30l) . we conclude that there are at most 
finitely many times at which / fl J l (n) = and / fl J 1 (n + 1) ^ 0. This together with the fact 
that lnJ l (n) = happens infinite times, shows that there exists T x > such that If] J x {n) = 0, 
Vn > T\. 
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k — 1 — > k (1 < k < c): Assume that for a fixed n > max{XJ|l < I < k}, we have / fl J k {n) = 
and / fl J fc (n + 1) ^ 0. Thus, there exists i G I such that z G J fc (n + l)\J fe (n). Therefore, 

£ |^(n)(X,H - Xi(n))| > e (32) 

Once again, we note that |jf=i J\ n ) Q I> an d repeat steps (|26l )-(l30T) to show that there exists 
T fc > such that I n J k (n) = 0, > T fe . ■ 
Corollary 2: A chain {y4(n)} G is ergodic if and only if it has the infinite jet-flow property. 



B. Weakly Aperiodic Chains / Ti9l/ 

In this part, we see how the weak aperiodicity property, as defined in |fT9l , guarantees the 
infinite jet-flow property to hold over each island. In accordance with [fT9l , weak aperiodicity 
of a chain is defined as follows: 

Definition 8: A chain {A(n)} of stochastic matrices is said to be weakly aperiodic if there 
exists 7 > such that for every distinct i,j G M and each n > 0, there exists / G M such that 

A li {n).A lj {n)> 1 A ij (n). (33) 

Lemma 2: Let {A(n)} be a chain of stochastic matrices that is weakly aperiodic. Then, the 
infinite jet-flow property holds over each island of {A(n)}. 

Proof: Let {A(n)} be weakly aperiodic, I be an arbitrary island of {A(n)}, and J be an 
arbitrary jet in /. If jet-limit J* exists, since I is a connected component of the infinite flow 
graph, U(J*, I\J*) is unbounded. Consequently, U(J,I\J) is unbounded. Thus instead, assume 
that for jet J, the jet-limit does not exist. Therefore, for infinitely many times n, we must have: 
J(n + 1) ^ J(n). Let n be fixed and J(n + 1) % J(n). Thus, there exists i G J(n + l)\J(n). 
From the weakly aperiodicity property of {A(n)}, for every j G J(n), there exists / G M such 
that: 

7Ai(n) < A H (n).A l3 (n) < mm{A u {n), A^n)} < U n (J, M\J) (34) 

where U n is defined in Eq. ©. The reason for the last inequality is that, no matter / G J(n + 1) 

or / G" J(n + 1), one of Au(n), Aij(n) appears in U n (J,M\J). Hence, 

£ 7A» < |J(n)|[/ n (J,M\J). (35) 
jeJ(n) 
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On the other hand, 

E 74» = 7 E ^(^=7 11^)1- E A^n) ) > 7(|J(n)| - U n (J,M\J)) 

jeJ(n) jeJ(n) \ j<£J(n) I 

(36) 

Relations (1351) and (l36l) imply: 

t/n(J, M\J) > tI^NI/(7 + I^NI) > 7/(1 + 7) (37) 

Since inequality (1371) holds for infinite times n, U(J, M\J) = Y^=o U n (J, M\J) is unbounded. 

■ 

Theorem |5] and Lemma |2j immediately imply the following corollary which is the deterministic 
counterpart of Theorem 4 of [fl9l . 

Corollary 3: every weakly aperiodic chain in class V* is class-ergodic. 

C. Self-Confident and Cut-Balanced Chains ^ 

Definition 9: H A chain {A{n)} of stochastic matrices is self-confident with bound 5 if 
Au(n) > 5, Vi £ M, Vra > 0. 

Definition 10: flU A chain {A(n)} of stochastic matrices is cut-balanced with bound ^ if 
for every Mi C M and n > 0: 

E E M") <*EE 08) 

Theorem 6: 01, |fl9ll If chain {v4(n)} is self-confident and cut-balanced, then it is class- 
ergodic and the islands form the ergodic classes of {A(n)}. 

Proof: Assume that {A(n)} has self-confidence and cut-balance properties with bounds 5 
and ^ respectively. Since {A(n)} is in class V* ( Ifl9l , Theorem 7), from Theorem |5] it is 
sufficient to show that for an arbitrary island / and an arbitrary proper jet J in /, we have 
U(J,I\J) = 00. Indeed, if jet-limit J* exists, unboundedness of U(J,I\J) is immediately 
implied from unboundedness of U(J* , I\J*). Otherwise, there are infinite times n such that 
J(n) 7^ J(n + 1). At every such n, there exists i E I such that i G (J(n)\J(n + 1)) U (J(n + 
l)\J(n)). Therefore, U n (J, I\J) > Aa(n) > 6. Since there are infinite such times, U(J,I\J) 
is unbounded. ■ 
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D. Balanced Asymmetric Chains ^ 

Definition 11: flU A chain {A(n)} of stochastic matrices is said be balanced asymmetric 
with bound if for every subsets Mi, M 2 C M of the same cardinality, and for every n > 0: 

£ £ Ay(n) < viz E Af(") (39) 

Theorem 7: Every balanced asymmetric chain is in class V*. 
To prove Theorem [7] we first state the following lemma. 

Lemma 3: Let A^xn be a balanced asymmetric matrix with bound ^ Then, there exists a 
permutation matrix Pnxn such that the product PA is self-confident with bound 5 = 4/ (\I/iV 2 + 
4JV-4). 

Proof: Form a bipartite-graph ?i(V,£) from A with iV nodes in each part. Let V\ and V2, 
each a copy of M, be sets of nodes of the two parts of H. For every i G Vi and j G V2, connect z 
to j if Ay > 5 = 4/(\[>iV 2 + 4iV-4). We wish to show that % has a perfect matching. By Hall's 
Marriage Theorem, it suffices to show that for every subset /C C V\, we have |Z?(/C)| > |/C| 
where 

D{K) = {j G V 2 |3z G /C s.t. G 8} (40) 

Assume that on the contrary, there exists K, C Vi such that fc' = |-D(/C)| < |/C| = k. Let 
/C = {ci, . . . , Cfc} and -D(/C) = {di, . . . , d^'}- Define /C' C /C by K! — {ci, . . . , c^/}. We now 
have: 

Ai i < k '( N - k "> 6 - 6n2 / a - ( 4l ) 

ie/C' j<£D(K) 

On the other hand, 

Sig/C' YljeD(K) A? > J2ieK.\K' J2jeD(K) ^3 — {k — k') — J2ieK\K' Z^£D(/C) A? 

> (fc - fc') — (k — k'){N - k')5 >1 — (N — 1)5. 

Since K',D(K) C M are of identical cardinalities, the balanced asymmetry property of A 
together with inequalities (RTI) and (|42l) imply that 

1 - (N - 1)5 < 5^N 2 /A (43) 

Thus, 5 > 4/(\I/iV 2 + 4iV — 4), which is a contradiction. Therefore, % has a perfect matching and 
consequently, there exists a permutation r such that A T ^ ti > 5, Vi. Consequently, the permutation 
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matrix P with e T u\ as its ith row, where ej denotes a row vector of length N with 1 in the jth 
position and in every other position, is such that the product PA is self-confident with 5. ■ 
Proof of Theorem 0' We now prove Theorem [7J Let {A(n)} be a balanced asymmetric 
chain with bound ^J/. Set: 5 = A/^N 2 + AN — 4). We recursively define sequence {P(n)} of 
permutation matrices as follows: From Lemma |3] we know that there exists a permutation matrix 
P(0) such that the product P(0)A(0) is self-confident with 5. Find permutation matrix P(n), 
n > 1, such that the product P(n)74(n)P*(n — 1) is self-confident with 5. Note that existence of 
P{n) is implied by Lemma [3l taking into account that the product v4(n)P*(n — 1) is balanced 
asymmetric with bound since the columns of the product are a permutation of the columns 
of A(n), itself a balanced asymmetric matrix with bound Hence, if we define chain {B(n)} 
by: 

B(n) = P{n)A{n)P\n - 1), (44) 

then, {B{n)} has both self-confident and balanced asymmetry properties. Since balanced asym- 
metry is stronger than cut-balance, from IU~9l we conclude that chain {B{n)} belongs to the set 
V*. Furthermore, it is straightforward to show that if {n(n)} is an absolute probability sequence 
adapted to chain {B(n)}, then {-n(n)P(n — 1)}, where P{— 1) = Inxn, is an absolute probability 
sequence adapted to chain {A(n)}. This immediately implies that {A(n)} 6 V* . ■ 

From Theorem [7] we know that, as for the class V*, the components of the absolute probability 
process are uniformly bounded away from zero, and also there is no J° in the jet decomposition 
of the D-S Theorem. Therefore, we again consider J 1 , . . . , J c as the jet decomposition. 

Theorem 8: If {A(n)} is balanced asymmetric, then the cardinality of each jet in the jet 
decomposition of the D-S Theorem, becomes time-invariant after a finite time. 

Proof: Let {A(n)} be balanced asymmetric with bound ^J/. It suffices to show that there 
are finite times in which cardinality of a jet, in the jet decomposition of the D-S Theorem, 
increases by at least 1. In the following, we see what happens when the cardinality of a jet, say 
J k , increases. Assume that for a fixed n > 0, we have | J k (n + 1)| > | J k {n)\. For an arbitrary 
i E J k {n + 1), let T C J k (n + 1) be such that i^T and |T| = | J k {n)\. Thus by the balanced 
asymmetry property, 

j£j k {n) l£T j£j k (n) l&T j£J k (n) l£j k {n+l) j£J k (n) 
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Therefore, 

E E ^(n)<|J fe (n+l)|.f E E a *» (46) 

i£ J k {n+1) j£J k (n) ieJ fe (n+l) j£J k {n) 

On the other hand, 

E E ay(») = lA" + l)|- E E a *» ^ 

i£j k (n+l) j£J k {n) i£j k (n+l) j<£J k {n) 

Eqs. (O and (07]) together imply: 



E 



El J fe (n + 1 1 1 i 
a«(n) > — 1 — r-r- — ^— > (48) 
n ; - 1 + * \J k (n + l)\ - 1 + 

ieJ fe (n+l) i^J fe (n) 1 V 71 

Once again since the total interactions between J k and J k is finite over the infinite time interval, 
inequalities (|48l can occur for finitely many times n, and this completes the proof. ■ 
An immediate corollary of Theorem [8] as follows. 

Corollary 4: [4] Consider a multi-agent system with dynamics (OQ), where {A(n)} is balanced 
asymmetric. Then, Zi(n) converges for every i e M, as n goes to infinity, where Zi(n) is the zth 
least value among X\{n), . . . , X N (n). 

Definition 12: [fT8l A chain {A(n)} of stochastic matrices is said to have the absolute infinite 
flow property, if for every jet J in M with a time-invariant size, U(J, M\J) is unbounded. 

Theorem 9: [4] If {A(n)} is balanced asymmetric, then, {A(n)} is class-ergodic if and only 
if the absolute infinity property holds over each island of {A(n)}. Furthermore, in case of 
class-ergodicity, islands are ergodic classes are {A(n)}. 

Proof: From Theorem [7] we know that {A(n)} & V*. Therefore, taking advantage of 
Theorem |5] it suffices to show that absolute infinite flow and infinite jet-flow properties are 
equivalent on each island. Obviously, the former is implied from the latter. We prove the converse 
as follows: Let the absolute infinite flow property holds over each island. Assume that / is an 
arbitrary island of {A(n)} and J is an arbitrary jet in /. If the cardinality of jet J becomes 
time-invariant after a finite time, unboundedness of U(J,I\J) is immediately implied from the 
absolute infinite flow property over /. Otherwise, the cardinality of J increases infinitely many 
times by at least 1. In this case, from the proof of Theorem |8] we know that V(J, M\J) is 
unbounded, and consequently U(J,M\J) is unbounded following Lemma [B Moreover, 

U(J, M\J) + U(I\J, M\I) = U(J, I\J) + U(I, M\I) (49) 
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Since U(I,M\I) is bounded, unboundedness of U(J,M\J) implies that U(J,I\J) = oo. This 
completes the proof. ■ 
Corollary 5: flU If chain {A(n)} is balanced asymmetric, then it is ergodic if and only if it 
has the absolute infinite flow property. 

V. Conclusion 

We considered a general linear distributed averaging algorithm in discrete time. Following 
the work by Touri and Nedic lfl8l . and recalling the notion of jets from [2], we introduced a 
property of chains of stochastic matrices, i.e., the infinite jet-flow property, that happens to be 
a fairly strong necessary condition for ergodicity of the chain. Moreover, for the chain to be 
class -ergodic, the infinite jet-flow property must hold over each connected component of the 
infinite flow graph, as defined in |[T9l . 

We then illustrated the close relationship between the D-S Theorem by Sonin [H"5l and 
convergence properties of consensus algorithms. By employing the D-S Theorem, we showed 
that the necessary conditions found earlier, are also sufficient in case the chain is of the class 
V* lfl9l . We argued that the previous related results in the literature, 0], fl9], lfl9l in particular, 
can be simply implied by the equivalent conditions that we obtained. In future work, we shall 
extend our results to the case when the number of agents increases to infinity, although the D-S 
Theorem holds only if N is finite. 
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